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CLOSED  FORM  CHARACTERISTIC  FUNCTION  FOR  GENERAL  COMPLEX 
SECOND-ORDER  FORM  IN  CORRELATED  COMPLEX  GAUSSIAN  RANDOM  VARIABLES 

INTRODUCTION 

The  evaluation  of  the  performance  of  signal  processors  in 
Gaussian  noise  and/or  a  fading  medium  frequently  centers  on 
finding  the  ensemble  average  of  an  exponential  of  a  complex 
second-order  form;  for  example,  see  [1].  Furthermore,  this 
complex  form  can  involve  complex  vectors  with  arbitrary  means 
and  covariance  matrices.  Here,  we  will  address  and  solve  the 
following  specific  problem. 

Random  vector  Z  is  Nxl  with  an  arbitrary  mean  vector  Z  and 

U  ip 

covariance  matrices  Z  Z  and  Z  Z  .  Vectors  D1  and  D2  are  Nxl 
complex  constant  column  vectors,  while  C^,  C 2,  C^,  C^  are  Nxn 
complex  constant  matrices.  The  general  complex  form  c  is  defined 
as 

C  =  dJ  Z  +  dJ  Z*  +  ZH  Cj  Z  +  ZH  C2  z*  +  zT  C3  Z  +  ZT  C4  Z*  .  (1) 

The  quantity  of  interest  is  the  characteristic  function  fc(a), 
defined  here  as  the  ensemble  average  (over  Gaussian  vector  Z), 

fc(a)  =  exp(ac)  ,  (2) 

where  a  is  an  arbitrary  complex  scalar.  This  characteristic 
function  will  be  found  in  its  most  compact  form,  convenient  for 
rapid  evaluation  for  numerous  values  of  a. 
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In  order  to  solve  this  problem,  it  is  nece  ~ary  to  solve  a 
generalized  characteristic  value  problem,  with  non-Hermitian 
complex  matrices,  for  the  complex  right  and  left  eigenvectors. 
Accordingly,  the  next  section  is  devoted  to  reviewing  the 
properties  of  generalized  characteristic  value  problems  for 
complex  matrices  and  to  developing  the  necessary  expansions  of 
relevant  determinants  and  matrices.  These  properties  and 
expansions  are  then  used  in  the  succeeding  section  to  derive  a 
closed  form  result  for  characteristic  function  fc(a)  in  (2). 
Some  related  work  appears  in  [2]. 
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RIGHT  AND  LEFT  EIGENVECTORS  OF  GENERALIZED  CHARACTERISTIC 
VALUE  PROBLEM  WITH  NON- HERMIT IAN  COMPLEX  MATRICES 

Let  Mxm  matrices  B  and  C  be  complex  non-Hermitian,  and  let 
matrix  C  be  nonsingular.  The  right  Mxl  (column)  eigenvectors 
{RmJ  and  corresponding  eigenvalues  fXm),  both  of  which  are 
generally  complex,  of  the  generalized  characteristic  value 
problem  satisfy  the  vector  equations 

B  R  =  X  C  R  for  1  £  m  <  M  .  (3) 

m  m  m 

Since  this  can  be  written  as 

(B  -  X  C)  R  =0  for  1  <  m  <  M  ,  (4) 

m  m 

the  complex  eigenvalues  { Xm }  can  be  found  from  the  determinant 

det ( B  -  X  C)  =  0  .  (5) 

Because  matrix  C  is  nonsingular,  then  det(C)  ^  0,  meaning  that 

M 

the  term  X  appears  on  the  left  side  of  (5).  Therefore,  there 
are  M  roots  of  (5),  denoted  by  eigenvalues  { J ,  which  are 
assumed  to  be  distinct. 

From  (4),  it  follows  that  the  M  elements  of  the  m-th  right 
column  eigenvector  Rm  are  proportional  to  the  M  cofactors  of 
respective  elements  of  any  ro^  of  the  matrix  B  -  Xm  C  [3;  page 
113,  problem  71].  Alternatively,  eigenvector  Rm  is  proportional 
to  any  column  of  the  adjoint  matrix  of  B  -  Xm  C.  Thus,  each  Rm 
is  uniquely  determined  by  (4),  except  for  a  complex  scale  factor. 
The  absolute  scaling  of  each  Rm  is  fixed  here  by  requiring  it  to 
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have  unit  length: 

RH  «  =1  for  1  £  m  £  M  .  (6) 

m  n 

However,  each  Fm  is  still  ambiguous  within  a  phasor  exp(i6m), 
where  each  6m  is  real  but  arbitrary. 

The  set  of  M  right  eigenvectors,  {R^},  are  linearly 
independent  when  the  M  eigenvalues  {Amj  are  all  distinct.  To 
prove  this,  assume  that  the  first  n  eigenvectors  are  linearly 
independent,  but  that  the  n+1  eigenvector  is  linearly  dependent; 
that  is,  assume  that  we  can  write 


Rn+1  r  am  Rm  ' 

m=  1 


(7) 


where  at  least  one  of  the  coefficients  |am)  is  nonzero.  Then, 
pre-multiplying  (7)  by  matrix  B,  we  find 


B  R 


n+1 


(8) 


or,  using  ( 3 ) , 


n 

A  .  C  R  . ,  =  El  a  Am  C  Rm  . 
n+1  n+1  *■ — r  mm  m 

m=  l 


(9) 


.-1 


Pre-multiply  (9)  by  matrix  C~  ,  since  C  is  nonsingular,  to  get 


n 


A  .  R  .  ) _  a  A  R  . 

n+1  n+1  t — t  m  m  m 

m=  l 


(10) 


Now,  multiply  (7)  by  An+1,  and  subtract  it  from  (10),  to  obtain 


n 


m=l 


{k  -  A  . )  a_  R_  =  0  . 
'  m  n+l  m  m 


(ID 
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Because  eigenvectors  Rj,...,R  have  been  assumed  linearly 
independent,  all  n  coefficients  in  (11)  must  be  zero.  But,  since 
at  least  one  am  ^  0,  then  at  least  one  of  the  eigenvalues 
Xi,...,Xn  must  equal  An+^.  This  contradicts  the  assumption  of 
distinct  eigenvalues.  Therefore,  assumption  (7)  is  invalid; 
rather,  all  eigenvectors  are  linearly  independent.  Then,  the 
right  MxM  normalized  modal  matrix 

R  s  [Rj  •  •  •  Rm]  (12) 

u 

is  nonsingular.  Despite  (6),  it  should  be  noted  that  R  R  /  I, 
in  general,  due  to  matrices  B  and  C  being  non-Hermitian. 

The  left  Mx l  (column)  eigenvectors  {LmJ  and  corresponding 
eigenvalues  (Ymi/  both  generally  complex,  of  the  generalized 
characteristic  value  problem  satisfy  the  vector  equations 

L»  B  =  Y  L»  C  for  1  <  m  <  M  ,  (13) 

m  m  m 

or 

l“  (B  -  C)  =0  for  1  <  m  <  M  .  (14) 

The  left  eigenvalues,  I Ym I #  are  found  from  the  determinant 
equation,  det(B  -  y  C)  =0,  which  is  identical  in  form  to  (5). 
Therefore,  the  left  and  right  eigenvalues,  of  the  two  generalized 
characteristic  value  problems  (3)  and  (13)  for  matrices  B  and  C, 
are  the  same;  that  is, 

Y  =  X  for  1  <  m  <  M  .  (15) 

'mm 
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Therefore,  (14)  can  be  written  as 

Lm  (B  "  Xm  C*  =  0  for  1  *  i  M  »  (16) 

meaning  that  the  M  elements  of  left  (column)  eigenvector  Lm  are 
proportional  to  the  M  cofactors  of  respective  elements  of  any  row 
of  the  matrix  (B  -  X  C)  .  Each  Lm  is  uniquely  determined  by 
(16),  except  for  a  complex  scale  factor.  The  absolute  scaling  of 
each  Lm  is  fixed  here  by  requiring  it  to  have  unit  length: 

LH  L  =1  for  1  <  m  S  M  .  (17) 

mm 

However,  each  Lm  is  still  ambiguous  within  a  phasor  exp(i$m), 
where  each  <)»m  is  real  but  arbitrary. 

The  set  of  M  left  eigenvectors,  { Lm } ,  are  linearly 
independent  when  the  M  eigenvalues  {XmJ  are  all  distinct. 

(The  proof  parallels  that  presented  for  the  right  eigenvectors 
in  (7)  -  (12).)  Then,  the  left  MxM  normalized  modal  matrix 

L  s  fL1  .  .  .  Lm]  (18) 

is  nonsingular.  Again,  despite  (17),  we  should  observe  that 
L  L  ^  I  in  general,  due  to  matrices  B  and  C  being  non-Hermitian. 
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PROPERTIES  OF  EIGENVECTOR  MATRICES  R  AND  L 

Define  Mxm  complex  diagonal  eigenvalue  matrix 

A  =  diaglAj  .  .  .  XM]  .  (19) 

Then,  generalized  characteristic  value  problems  (3)  and  (13)  can 
be  written  in  the  compact  matrix  forms 

B  R  =  C  R  A  ,  LHB=ALHC,  (20) 

by  means  of  (12),  (15),  and  (18).  All  M  eigenvalues,  are 

nonzero  if  and  only  if  matrix  B  is  nonsingular. 

Define  complex  mxm  matrix 

D  =  LH  C  R  .  (21) 

H 

Now,  pre-multiply  the  left  equation  in  (20)  by  L  ,  and  post- 
multiply  the  right  equation  in  (20)  by  R.  There  follows, 
respectively,  upon  use  of  (21), 

LHBR=DA,  LHBR=AD.  (22) 

Since  the  left-hand  sides  are  identical,  we  must  have  D  A  =  A  D. 

However,  because  eigenvalue  matrix  A  in  (19)  is  diagonal,  with 

distinct  element  values,  it  follows  that  square  matrix  D  ■  [dmn] 

must  also  be  diagonal.  The  proof  of  this  very  important  claim  is 

as  follows:  the  m,n  element  of  product  D  A  is  An  dmn/  while  the 

m,n  element  of  A  D  is  X  d _ .  Because  these  elements  must  be 

equal,  this  leads  to  (X„  -  k)  dm„  *  0.  But,  if  all  the 
^  1  n  m  mn 

eigenvalues  (Am)  are  distinct,  then  we  must  have  dmn  *  0  for 
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m  ^  n;  that  is,  matrix  D  is  diagonal.  However,  matrix  D  is 
generally  not  a  multiple  of  the  identity  matrix  I. 

Denote  the  m-th  diagonal  element  of  D  by  dm;  that  is, 

D  =  diag[dj  .  .  .  dM]  .  (23) 

Given  the  unit-length  eigenvectors  (Rm)  and  { Lm j  (obtained,  for 
example,  via  the  procedures  mentioned  in  the  sequels  to  (5)  and 
(16),  respectively),  we  can  compute,  according  to  (21)  and  (23), 
the  complex  scalars 

d„  =  lJI  C  R  for  1  <  m  <  M  .  (24) 

m  m  m 

Then,  from  (21)  -  (24),  we  have  the  two  orthogonality  rules 

LH  C  R  =  D  -  diag[dj  .  .  .  dM]  ,  (25) 

LH  B  R  =  D  A  =  diagtdjAj  .  .  .  dMAM]  .  (26) 

All  diagonal  elements  {dmJ  of  matrix  D  in  (23)  -  (25)  are 
nonzero.  This  can  be  seen  by  computing  the  determinant  of  (25): 

H  M 

det ( L  )  det(C)  det(R)  =  det(D)  =  Jl  dm  .  (27) 

m=l  m 

But,  since  all  three  matrices  on  the  left  side  are  nonsingular, 
the  left  side  must  be  nonzero,  meaning  that  the  product  on  the 
right  side  must  be  nonzero. 

Furthermore,  by  appropriate  choices  of  the  arbitrary  phasors 
{6^}  and  {<j>m}  associated  with  the  right  and  left  eigenvectors 
|Rm)  and  f Lm } ,  respectively,  it  is  easily  arranged  for  all  { dm } 
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calculated  via  (24)  to  be  real  and  positive.  Then,  the  diagonal 
matrix  in  (25)  contains  only  positive  real  elements.  However, 
the  diagonal  matrix  in  (26)  will  still  generally  be  complex, 
because  the  eigenvalues  are  complex. 
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EXPANSIONS  OF  MATRICES 


Various  matrix  expansions  and  determinants  are  possible  from 
the  above  relations.  We  start  with  (20)  and  find,  for  complex 
scalar  0,  that  we  can  express 

C-0B  =  C-  0CRA  R_1  =  C  R  (I  -  0  A)  R-1  .  (28) 

There  immediately  follows  the  determinant 

M 

det (C  -  0  B)  «  det(C)  det(I  -  0  A)  =  det(C)  TT  (1  -  0  A  )  .  (29) 

m=l  m 

Once  the  eigenvalues  (^m)  have  been  evaluated  from  (5),  this 
expression  allows  for  rapid  evaluation  of  the  determinant  of 
C  -  0  B  for  numerous  values  of  complex  scalar  0.  The 
eigenvectors  are  not  required  for  this  calculation. 

From  (21),  we  have  the  useful  result  for  the  inverse, 

R-1  =  D~ 1  LH  C  .  (30) 


When  we  combine  this  with  (28),  we  obtain  a  diagonal  expansion 
for  the  following  matrix: 


(C  -  0  B)"1  =  R  (I  -  0  A) 


-1  „-l 


=  R  (I  - 


0  A)"1  D~ 1  LH  = 


M 


m=l  m 


(1-0 


A  ) 
nr 


H 

m  "m 


R_ 


Mr. 

Al 


l 


M 


(31) 


tl 

That  is,  terms  of  the  form  Rm  Ln,  with  m  ^  n,  do  not  appear. 
Once  the  right  and  left  eigenvectors  have  been  evaluated,  this 
result  allows  for  rapid  evaluation  of  the  inverse  of  matrix 
C  -  0  B  for  numerous  values  of  complex  scalar  0.  Special  cases 
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of  (31)  follow  immediately : 


,-l 


M 


_  —  r  lh 

£—r  d  m  m  ' 
m=  l  m 


B 


-1 


M 


1  R  r  H 

d_  X_  Rm  Lm 


(32) 


m=l  ~m  m 


The  latter  expansion  is  valid  if  all  the  eigenvalues  (A.m)  are 
nonzero,  that  is,  if  matrix  B  is  nonsingular. 

EXAMPLE 


A  numerical  example  of  the  relationships  above,  with  complex 
matrix  elements,  eigenvalues,  and  eigenvectors  is  presented  below 
for  M  «  2.  As  mentioned  above,  the  phasors  associated  with  the 
eigenvectors  have  been  chosen  to  lead  to  a  purely  positive  real 

u 

diagonal  matrix  D.  The  matrix  L  R  has  been  added  to  illustrate 
its  nonorthogonal  behavior. 


30-il0 

ilO 

30 

-15+i5 

B  = 

i 

C  = 

-18+i6 

8-i6 

-10 

9-i3 

A  =  diag[l+i  1 — i J  ,  R  = 


1 

i 

1 

1 

i 

1+i 

1+i. 

K 

II 

hi 

2+i 

2+i 

RHR  = 


.  2+i 

3 

r  Ht 

.  5+i 

L  6 

T  Hn  /2 

4+i 

3+i2 

2-i  i 
l  3  1 

,  L  L  = 

¥  i] 

,  L  R  -  -g 

3 

4+i 

lH  c  r  .  D  .  10^2 


1  0 
0  2 


LH  B  R  =  A  D  = 


1+i  0 

0  2-i2 


(33) 
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APPROXIMATE  SOLUTION  OF  INTEGRAL  EQUATION 


The  results  above  are  relevant  and  useful  if  we  want  to  solve 
the  following  integral  equation  for  r(y),  with  nonsymmetric 
functions  b(x,y)  and  c(x,y): 

J  dy  b( x,y )  r(y)  =  X  J  dy  c(x,y)  r(y)  ,  (34) 

We  discretize  (34),  leading  to  approximation 

)  '  b(kA,nA)  r(n A)  =  X  )  '  c(kA,nA)  r(nA)  .  (35) 

n  n 

In  terms  of  matrices,  this  is 


B  R  =  X  C  R  , 


(36) 


T 

where  column  vector  R  =  [ .  .  .  r(nA)  .  .  .]  here.  This  equation 
will  have  solutions  only  for  certain  values  of  scalar  X: 


B  R_  =  X_  C  R_ 


m 


m 


m 


m 


rm(nA)  .  .  .]T  .  (37) 


At  this  point,  we  have  the  characteristic  value  problem  posed 
earlier  in  ( 3 ) . 

The  alternative  integral  equation  for  X(x),  where  we 
integrate  on  x  instead  of  y,  is 

J  dx  X*(x)  b(x,y)  =  y  J  dx  X*(x)  c(x,y)  .  (38) 

This  can  be  discretized,  leading  to  approximation 


Y~2  X*(kA)  b(kA,nA )  =  Y  YU  **(*&)  c(kA,nA)  ,  (39) 

k  k 


or,  in  terms  of  matrices, 
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LH  B  -  Y  LH  C  , 


(40) 


T 

where  column  vector  L  -  .  .  X(kA)  .  .  .]  here.  There  are 

solutions  to  (40)  only  for  certain  values  of  scalar  y: 


l“  B  =  ym  lU  C  ,  L  =  ( 

m  'mm  m 


.  X  (kA)  . 
m 


This  problem  is  now  identical  to  that  considered  earlier  in  (13). 
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ALTERNATIVE  FORMS  OF  GENERALIZED  CHARACTERISTIC  VALUE  PROBLEMS 

The  generalized  characteristic  value  problems  were  given  in 
(20)  in  the  compact  matrix  forms 

B  R  =  C  R  A  ,  LHB=ALHC.  (42) 

If  we  pre-multiply  the  first  equation  in  (42)  by  C-1,  we  obtain 
an  alternative  matrix  form 

A  R  =  R  A  ,  A  =  C~ 1  B  ,  (43) 

with  right  eigen-solutions  R  and  A.  The  relation  of  these 
solutions  of  (43),  to  the  earlier  solutions  R  and  A,  is  taken  up 
in  appendix  A.  The  matrix  A  is  not  necessarily  Hermitian,  even 
if  both  matrices  B  and  C  are  Hermitian. 

Similarly,  if  we  post-multiply  the  second  equation  in  (42)  by 
C'1,  we  obtain  yet  another  form, 

LH  A  =  A  LH  ,  A  s  B  C-1  ,  (44) 

with  left  eigen-solutions  L  and  A.  The  relation  of  these 
solutions  of  (44),  to  the  earlier  solutions  L  and  A,  is  also 
addressed  in  appendix  A.  Matrix  A  is  not  necessarily  Hermitian, 
even  if  both  matrices  B  and  C  are  Hermitian.  For  the  example 
given  earlier  in  (33),  the  matrices  defined  in  (43)  and  (44)  are 


0 

1 

-  1 

10 

15+i5 

A  = 

-2 

2 

,  A  =  ? 

,-3+i 

0 

Matrix  A  happens  to  be  real  but  is  nonsymmetric .  Its  eigenvalues 
are  complex,  and  are  given  by  A  in  (33). 
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SPECIAL  CASE  OF  SYMMETRIC  (NOT  HERMITIAN )  MATRICES  B  AND  C 

If  Mxm  complex  matrices  B  and  C  are  both  symmetric,  that  is, 
T  T 

B  =  B  ar^  C  =  C,  (which  is  not  the  Hermitian  case),  then  (20), 
with  the  left  equation  transposed,  reads  as 

RT  B  =  A  RT  C  ,  LH  B  =  A  LH  C  .  (46 


There  follows  immediately,  for  this  special  case. 


LH  =  RT  ,  L  =  R*  ,  L  =  R*  . 

mm 


(Actually,  the  phasor  of  each  Lm  could  be  different  from  that  of 
R  . )  These  relations  allow  for  simplifications  in  the  numerical 
calculation  of  the  complex  eigenvectors;  also,  because  there  is 
now  only  one  fundamental  set  R  (with  L  =  R*),  the  scaling  of  the 
eigenvectors  can  be  altered  to  suit  our  convenience.  In 
particular,  we  now  scale  eigenvector  matrix  R  so  that  diagonal 
matrix  D  in  (25)  becomes  the  identity  matrix.  Then, 
orthogonality  relations  (25)  and  (26)  reduce  to 


T  T 

R  C  R  =  I  ,  R  BR  =  A, 


while  expansion  (31)  becomes 


(C  -  e  B)-1  =  ZZ  1 — Vx-  \  Rl  '•  f  *  xr . r; 

m= 1  m  i  m 


(49) 
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EXAMPLES  FOR  M  =  2 


The  first  example  has  symmetric  complex  matrices  B  and  C, 
with  the  scaling  of  normalized  modal  matrix  R  now  taken  according 
to  the  first  relation  in  (48). 


B 


A 


-2+i6  2 

1 

i6 

l-i3 

2  -l-i3 

'  C  2 

.  l-i3 

-1 

1  i 


=  diag[l+i  1 — i ]  ,  L*  =  R 


2 


72 


/ 


1+i  1+i 

2  TT 


3 

2+i 

l+i2 

13 

4 

272 

T 

,  R  R  = 

4 

272 

2-i 

3 

i3 

-l+i2 

272 

2 

272 

2 

LH  C  R  =  R^  C  R  =  I  , 
LHBR=RTBR=a=  diag[ 1+i  1-i]  . 


(50) 


The  only  orthogonality  relations  satisfied  by  the  eigenvectors 
R  and  L  are  the  latter  two,  with  weighting  matrices  C  and  B, 

U 

respectively.  Notice  that  Rm  Rm  ^  1  anY  longer;  in  fact,  these 
values  are  3/4,  3/2  for  m  =  1,  2,  respectively. 
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A  second  example,  where  matrix  C  is  now  real  and  symmetric, 
is  presented  next;  matrix  B  is  complex  and  symmetric. 


1  2-i]  [3  1 

B  =  ,  C  = 

2-i  1+iJ  ll  2 


kl  =  .83284  -  i. 11405  ,  X2  =  -.63284  +  il. 11405  , 


[-.37548  +  i. 07156  .51657  +  i. 05202 

L  =  R  = 

-.38980  -  i. 09394  -.67808  +  i. 05400 


.30687  .06901  -  i. 14124 

.06901  +  i. 14124  .73226 


C  R 


27898  +  i. 01949  .07171  +  i. 06008 

07171  +  i. 06008  .72102  -  i. 01949 


1.03913  -i. 28249 

C  R  =: 

l  i . 28249  1.03913] 


*  I  ,  RT  B  R  =  A  =  diag[X1  X2]  . 


(51) 
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CHARACTERISTIC  FUNCTION  OF  MOST  GENERAL  COMPLEX 
FORM  WITH  FIRST-ORDER  AND  SECOND-ORDER  TERMS 


Let  Z  be  a  complex  Nxi  random  vector  with  real  and  imaginary 
parts  X  and  Y;  that  is,  Z  =  X  +  i  Y.  Let  D^  and  D2  be  complex 
Nxl  constant  vectors.  Let  C^,  C2,  C3,  C4  be  complex  Nxn  constant 
matrices,  which  need  not  be  Hermitian  or  symmetric. 

The  most  general  first-order  complex  form  in  vector  Z  is 


fj  =  dJ  Z  +  D^  Z*  =  (Dj  +  D2)T  X  +  i ( Dj  -  D2)T  Y  =  2  HT  W  ,  (52) 
where 


H 


D1  +  °2 
i(D!  *  °2> 


(53) 


H  is  a  complex  2Nxl  constant  vector  and  is  completely  arbitrary; 
that  is,  every  complex  element  of  H  can  be  independently 
specified.  W  is  a  real  2Nxl  random  vector. 

The  most  general  second-order  complex  form  in  vector  Z  is 

f2  s  ZH  Cj  Z  +  ZH  C2  z*  +  ZT  C3  Z  +  ZT  C4  Z*  =  WT  G  W  ,  (54) 

where 


G 


Cj  +  c2  +  c3  +  c4 
“i(Cj  +  ^2  -  C3  -  C4) 


i(Cj  -  c2  +  c3  -  C4) 

C.  -  C-  -  c,  +  c. 
12  3  4 


(55) 


G  is  a  complex  2Nx2N  constant  matrix,  which  need  not  be 
Hermitian.  G  is  completely  arbitrary;  that  is,  every  complex 
element  of  G  can  be  independently  specified.  However,  as  far  as 
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the  second-order  form  in  (54)  is  concerned,  only  the  symmetric 

part  of  matrix  G  is  active.  That  is,  we  can  replace  G  in  (54)  by 

its  symmetric  part  Gg  =  (G  +  G  )/2  (which  is  still  complex ) , 

without  affecting  the  value  of  f 2 ;  also,  see  appendix  B. 

T 

Therefore,  we  have  ±2  =  W  Gg  W. 

The  general  complex  form  of  interest  here  is 

c  =  f0  +  f,  =  WT  G  W  +  2  HT  W  =  WT  G  W  +  2  HT  W  .  (56) 

Z  1  s 

The  pertinent  statistics  of  real  random  vector  W  are 

-  H  ~ 

E  =  W  =  _  ,  K  =  Cov(W)  =  (W  -  W)  (W  -  W)  = 

YJ 


Here,  mean  E  is  a  real  2Nxi  constant  vector,  while  covariance  K 
is  a  real  2Nx2N  symmetric  constant  matrix.  Some  important 
aspects  about  obtaining  covariance  matrix  K  from  the  two  Mxm 
complex  covariance  matrices  of  complex  vector  Z  are  discussed  in 
appendix  C. 

We  assume  that  Z  is  a  complex  Gaussian  random  vector.  Then, 

X  and  Y  are  joint-Gaussian,  and  2Nxi  real  random  vector  W  is 
Gaussian  with  probability  density  function 

p(W)  =  (2n)‘N  (det  K)_>}  exp(-  |(W  -  E)T  K_1  (W  -  E)j  .  (58) 

The  statistical  quantity  of  interest  is,  for  complex  scalar  a. 
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the  characteristic  function  of  complex  random  variable  c  in 
(56);  in  particular,  the  characteristic  function  is  defined  here 
as  the  average  of  the  following  exponential: 

fc(a)  =  exp(ac)  =  exp|a  WT  Gs  W  +  a  2  HT  wj  = 

=  |  dW  p(W)  expja  WT  Gg  W  +  a  2  HT  w]  * 

=  (2n  )-N(det  K)-lsJdW  exp[-  W-E )  TK-1  ( W-E )  +  a  WT  Gg  W  +  a  2  HT  w] 

=  d-*5  exp(t)  ,  (59) 

where  [4;  section  8-3] 

d  =  det ( I  -  2  a  G  K)  =  det(I  -  2  a  K  G  )  , 

s  s 

1  T  -1  -1  1  T  -1 

t  =  i  v1  (K  -  2  a  G  )  V  -  ~  E1  K  x  E  , 

V  =  K_1  E  +  2  a  H  .  (60) 

T 

Covariance  K  is  a  symmetric  real  2NX2N  matrix,  Gg  =  (G  +  G  )/2  is 
a  symmetric  complex  2Nx2N  matrix  which  need  not  be  Hermitian, 
mean  E  is  a  real  2Nxi  vector,  H  and  V  are  complex  2Nxi  vectors, 
and  a  is  a  complex  scalar. 

In  general,  we  must  invert  2Nx2N  real  symmetric  matrix  K. 
Also,  we  must  invert  2NX2N  symmetric  complex  matrix  K-1  -  2  a  Gg, 
which  need  not  be  Hermitian,  and  which  depends  on  argument  a. 

If  X  =  0,  Y  =  0,  D1  =  0,  D2  *  0,  then  E  =  0,  H  =  0,  V  =  0, 
t  «  0,  and  we  need  only  evaluate  complex  determinant 
d  *=  det  (I  -  2  a  K  Gg),  which  depends  on  a. 
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SPECIAL  CASE  OF  Y  -  0 


Then,  complex  forms 

f1  =  (D:  +  D2)T  X  s  2  DT  X  , 

f2  *  XT  (Cj  +  C2  +  C3  +  C4)  X  S  XT  C  X  , 

C  «  XT  C  X  +  2  DT  X  *  XT  Cs  X  +  2  DT  X  .  (61) 

Matrices  C  and  D  are  complex  and  completely  arbitrary;  matrix 
T 

Cs  =  (C  +  C  )/2  is  the  symmetric  part  of  C. 

Identify  in  the  subsection  above, 

2N  -»  N  ,  W-»X,  E  ->  X  ,  Gs^cs/  H-»D,  K~»  Kxx  ,  (62) 

thereby  getting  the  characteristic  function  of  c  as 

fc(ct)  *  exp(ac)  =  d”1*  exp(tx)  ,  (63) 

where 

=  det<I  -  2  a  Kxx  Cs)  , 


t  * 


1  T 
—  V 

2  Vx 


Ik-1  -  2  a  C  ] 
I  xx  s) 


-1 


1  — T  -1  — 

V  -  4  X  K  X 
x  2  xx 


V.  * 


K  1  X  +  2 
xx 


a  D 


(64) 


Covariance  K  is  a  real  nxn  symmetric  matrix,  C  is  a  symmetric 

X  X  o 

complex  nxn  matrix  which  need  not  be  Hermitian,  mean  X  is  a  real 
Nxl  vecuor,  D  and  Vx  are  complex  Nxl  vectors,  and  a  is  a  complex 
scalar. 
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SIMPLIFICATION  OF  GENERAL  CHARACTERISTIC  FUNCTION  (59)  -  (60) 

In  (46)/  replace  integer  M  by  2N,  and  replace  symmetric  2Nx2N 
matrices  B  and  C  by  G  and  K-^,  respectively.  There  follows 

G  R  =  K-1  R  A  ,  LH  G  =  A  LH  K_1  ,  L  =  R*  .  (65) 

s  s 

Given  Gs  and  K,  solve  this  characteristic  value  problem  for  2N*2N 
complex  diagonal  eigenvalue  matrix  A  and  the  corresponding  2Nx2N 
eigenvector  matrix  R.  Then,  orthogonality  relations  (48)  become 

RT  K-1  R  =  I  ,  RT  Gg  R  =  A  .  (66) 

Now,  in  (29),  replace  (3  by  2a,  in  addition  to  the  above. 

There  follows 

1  1  2N 

det(K  -  2  a  G  >  =  det(K~l)  TT  (1  -  2  a  A  )  .  (67) 

s  m=l  m 


Comparison  with  determinant  d  in  (60)  then  yields 

2N 

d  =  det  ( I  -  2  a  K  G  )  =  TT  (1  -  2  a  A  )  .  (68) 

s  m=l  m 

This  quantity  can  be  quickly  evaluated  for  many  complex  values  of 
a,  once  the  2N  eigenvalues  in  (65)  have  been  determined. 

Also,  from  (49),  we  obtain  the  diagonal  expansion  for  the 
inverse  matrix. 


(K 


-1 


2  a  Gs) 


2N 


_ 1 _ 

2  a  Am 
nt 


m 


(69) 


This  enables  the  quantity  t  in  (60)  to  be  expressed  as 


23 


TR  10403 


t  1  ^  1 
2  hi  1  -  2  “  Xm 


T  T  1  T  -1 

V  Rm  Rm  V  “  4  E  K  E 
mm  z 


(70) 


When  we  use  the  definition  of  vector  V  in  (60),  there  follows 


t 


1 

2 


2N  (e 


m 


m=l 


+  2  a  h,)2 
_ m 

-  2  o  X 

m 


(71) 


where  we  have  defined  complex  scalars 

e„  =  ET  K-1  R  ,  h  =  HT  R_  ,  for  1  <  m  i  2N  .  (72) 

m  m  m  m 


For  a  =  0  in  (59),  we  have  fc(0)  =  1;  then,  d  in  (60)  or 
(68)  is  1,  meaning  that  t  must  be  zero  for  a  =  0.  Therefore, 
the  last  term  in  (71)  must  be  expressible  as 


1 

2 


E 


T 


f 


(73) 


this  can  also  be  verified  by  use  of  expansion  (69)  for  K  (upon 
setting  a  =  0  there).  Combining  these  results,  (71)  can  be 
simplified  to 


2N  k  e„ 

t  =  a  YZ  -!5— 1 - 
m=l 


+  2  em  hm  +  2  o  h 
_ m  m _ 

1  -  2  a  k 

m 


2 

m 


(74) 


This  expression  can  be  numerically  evaluated  very  easily  for 
numerous  values  of  complex  scalar  a,  once  the  scalars  in  (72) 
have  been  determined.  Also,  (74)  is  the  most  compact  form  for  t 
and  indicates  the  fundamental  form  for  characteristic  function 
fc(cx)  in  (59). 
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Combined  with  (68),  the  final  result  for  the  characteristic 
function  of  c  is 


£c<“> 


2N  X 

e2  +  2  e  h  +2 

a  h2) 

exp 

r - -  _m_ 

m  mm 

m 

a  2 _ _  _ 

1  -  2  a  A 

m=l 

m 

(75) 


This  is  equal  to  [1;  ( B— 54 ) ]  when  all  the  matrices  are  real.  In 
summary,  (75)  gives  the  result  for  ensemble  average,  exp ( ac ) ,  of 
complex  form 


m  T  T  T  ★ 

C  =  W  G  »  +  2  H  W  =  D  Z  +  D  Z  + 

S  12 

+  ZH  Cj  Z  +  ZH  C2  Z*  +  ZT  C3  Z  +  ZT  C4  z*  , 


(76) 


where  Z  is  a  random  complex  vector  of  size  Nxl,  { Xm J  and  )Rm)  are 
the  eigenvalues  and  right  eigenvectors,  respectively,  of  2Nx2N 
generalized  characteristic  value  problem  (65),  and  coefficients 
{ em }  and  { hm }  are  given  by  (72). 

If  we  expand  the  logarithm  of  this  characteristic  function  in 
(75)  in  a  power  series  in  a,  the  cumulants  (x0(k)}  of  complex 

V* 

form  c  are  found  to  be 


This  agrees  with  (1;  ( B— 65 ) ]  when  all  the  matrices  are  real. 


25 


TR  10403 


In  order  to  use  these  results  in  (75)  and  (77),  we  must  solve 
(65)  for  matrices  A  =  diagfA^^  .  .  .  anc*  R  =  tRl  *  *  *  R2N^' 

and  then  compute  scalars  (emJ  and  { hm }  by  means  of  (72). 

Attempts  to  derive  (75)  directly,  by  converting  complex  form 
(56)  to  a  sum  of  (complex)  squares  of  uncorrelated  Gaussian 
random  variables,  have  been  unsuccessful .  We  have  been  unable  to 
discover  any  (complex)  linear  transformation  to  accomplish  this 
goal  directly.  Nevertheless,  we  have  derived  closed  form  result 
(75),  which  is  the  most  compact  form  for  the  characteristic 
function  of  complex  random  variable  c  in  (56).  Additionally,  we 
can  obtain  the  ensemble  average 

1  ■  -  ■  —  ■  ■  » 
exp( 0c* )  *  exp( 0*c)  =  [fc(0*)]*. 
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EXAMPLE 


The  exact  result  in  (75)  was  compared  with  simulation 
results  for  the  example  given  earlier  in  (51),  where  M  =  2. 
Specifically,  we  took  N  =  1,  M  =  2N  =  2,  and 


1  2-i 

.4  -.2 

.,-1 

3  1 

,  K  = 

,  K 

2-i  1+i 

-.2  .6. 

1  2 

.43 

.77  + 

i .  69 

E  = 

/  H  = 

•  31 

•  93  - 

i .  57 

Then,  the  eigenvalues  and  eigenvectors  corresponding  to  matrices 

G„  and  K-1  are 
s 

Aj  =  .8328409  -  i. 1140487  ,  X2  =  -.6328409  +  il. 1140487  , 


=  R 


-.3754800  +  i. 0715611  .5165670  +  i. 0520160 

-.3897995  -  i. 0939362  -.6780828  +  i. 0539997 


(79) 


Notice  that  the  mean  vector  E  and  the  linear  transformation 
vector  H  are  both  nonzero  for  this  numerical  example.  This 
necessitates  the  calculation  and  use  of  eigenvector  matrix  R. 

For  a  =  -1.1  +  il.3,  (75)  yields  the  exact  result 

fc(a)  =  .241135  -  i. 008663  ,  (80) 

while  a  simulation  result  based  on  1E9  trials  of  the  exponential 
of  (56)  gave  the  estimated  value 

f  (a)  s  .241208  ±  .000037  -  i(. 008671  ±  .000028)  .  (81) 

c 
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The  ±  values  are  the  standard  deviations  estimated  during  the 
simulation. 

For  the  alternative  example  a  =  -2.1  +  i3.3,  the  exact  result 
is 

fc(a)  =  .746822  -  i. 410478  ,  (82) 

while  a  simulation  result  based  on  1E9  trials  of  the  exponential 
of  (56)  gave  the  estimated  value 

fc(a)  =  .74619  ±  .00076  -  i { .41150  ±  .00076)  .  (83) 

One  point  to  observe  about  these  estimates  are  their  rather  large 
standard  deviations,  unless  a  very  large  number  of  independent 
trials  are  taken.  We  will  return  to  this  point  below,  after  we 
have  discussed  the  region  of  convergence  of  the  multiple  integral 
in  (59). 
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CONVERGENCE  OF  MULTIPLE  INTEGRAL  IN  (59) 

In  order  that  the  multiple  integral  in  (59)  converge,  certain 
conditions  on  the  complex  2NX2N  matrix  K~*  -  2  a  Gg  must  be 
satisfied.  To  determine  these  conditions,  consider  general 
complex  2Nx2N  matrix  J  in  the  following  multiple  integral: 

f  dW  exp  WT  J  w)  ,  J  =  Jr  +  i  Ji  .  (84) 

Because  only  the  symmetric  part  of  matrix  J  is  active  in  (84),  J 
can  be  taken  symmetric  without  loss  of  generality.  Furthermore, 
only  the  real  part  Jr  affects  the  convergence  of  (84). 

Suppose  we  solve  for  the  2NX2N  eigenvalue  matrix  y  and 
eigenvector  matrix  Q  of  the  real  symmetric  matrix  Jr: 

Jr  Q  *  Q  Y  ,  QT  Q  -  I  ,  QT  Jr  Q  -  y  •  (85) 

Then,  with  Q  =  [ Q ^  .  .  .  Q2n],  we  have  matrix  expansion 

-1  T  T 

Jr  -  Q  Y  Q  -  Q  r  Qt  -  LZ  Ym  Qm  Q.  .  (86) 

m=  1 

allowing  the  real  part  of  the  exponent  in  (84)  to  be  developed  as 

T  2N_  2N_  2 

WJ  W  =  J~Z  Yra  W  Qm  QI  W  =  Y~2  Ym  v*  ,  (87) 

r  c — y  '  m  m  m  *- — s*  'mm' 

m=l  m=l 

where  2Nxl  column  vector  V  =  QT  W  =  [v^  .  .  .  v2n^T*  T^e 
transformed  integral  on  V  will  obviously  converge  only  if  ym  >  0 
for  all  m;  that  is,  all  the  eigenvalues  of  real  symmetric  matrix 
Jr  must  be  positive.  This  means  that  matrix  Jr  must  be  positive 
definite  in  order  for  integral  (84)  to  converge. 
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When  we  identify  J  with  K-2,  -  2  a  G  in  (59),  then 

& 

J  *  K_1  -  2  Re (a  G  )  .  (88) 

X  b 

For  the  example  in  (78),  this  matrix  is  equal  to 

3-2a  l-4a  -2a . 

r  r  l 

Jr  =  ,  a  =  a  +  i  a.  .  (89) 

r  l-4ar-2ai  2-2ar+2a.  r 

This  matrix  is  positive  definite  only  if  ar  <  1.5  and  if 

5  -  2  a  +  10  a.  -  12  a2  -  4  a?  -  20  a  a.  >  0  .  (90) 

r  l  r  l  r  l 

These  conditions  on  complex  variable  a  are  depicted  in  figure  1 
as  the  region  inside  the  hyperbola,  which  is  basically  in  the 
second  quadrant.  Any  values  for  a  outside  this  region  lead  to  a 
divergent  integral  (59);  that  is,  the  random  variable  exp(ac)  in 
(59)  has  an  infinite  average  value  when  complex  parameter  a  is 
outside  the  hyperbola  in  figure  1.  In  the  one-dimensional  case, 
this  is  similar  to  the  example  of  a  zero-mean  unit-variance 
Gaussian  random  variable  x  with  transformed  average  value 

exp(ax2)  =  J  dx  (2n)_Js  exp|-  ^  x2  +  a  x2j  (91) 

being  infinite  if  ar  >  1/2. 

In  general,  matrix  Jr  in  (88)  must  be  positive  definite  in 
order  that  (59)  converge,  that  is,  in  order  for  random  variable 
exp(ac)  to  have  a  finite  average.  That  latter  value  is  then 
given  by  (59)  and  (60).  The  region  dictated  by  the  positive 
definiteness  of  Jr  can  take  on  a  variety  of  shapes.  For  example. 
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if  the  2,2  element,  1+i,  of  Gg  in  (78)  is  replaced  by  3-i4,  the 
region  of  convergence  of  multiple  integral  (59)  is  the  interior 
of  a  circle  of  radius  3.25  centered  at  a  =  -1.75  -  i2.5.  Of 
course,  these  regions  always  include  the  origin  a  =  0. 

If  one  tries  to  estimate  the  ensemble  average  of  exp(ac)  by 
an  arithmetic  average  of  a  large  number  of  independent  trials, 
the  standard  deviation  is  found  to  be  rather  large,  especially 
near  the  boundary  of  convergence  of  integral  (59).  In  fact,  as  a 
approaches  the  boundary,  the  standard  deviation  tends  to  ®.  This 
makes  the  availability  of  closed  form  result  (75)  a  very  useful 
tool  for  analysis,  without  requiring  excessive  computer 
simulation  time. 
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EXTENSION  TO  JOINT  CHARACTERISTIC  FUNCTION 

The  joint  characteristic  function  of  the  real  and  imaginary 
parts,  cr  and  c^,  of  general  complex  form  c  in  (56)  was  derived 
in  [1;  page  141].  Attempts  to  simplify  that  result  have  not  been 
successful.  For  example,  the  determinant  in  [1;  (G-16)  -  (G-18)] 
takes  the  form  det(I  -  (  A  -  C  B),  where  A  and  B  are  constant  Mxm 
matrices,  and  £  and  C  are  complex  scalars.  Guided  by  (68),  we 
might  hope  that  this  determinant  would  take  on  the  form 

d  =  det( I  -  i:  A  -  C  B)  =  n  (l  -  Am  5  -  vm  c]  .  (92) 

However,  this  could  never  be,  because  there  are  not  enough 
degrees  of  freedom  on  the  right-hand  side  of  (92).  To 
demonstrate  this,  consider  the  following  example  for  M  =  2: 

3  1]  [4  2 

A  =  ,  B  =  ,  (93) 

1  2  12  3 

which  are  real  symmetric  matrices.  Then,  the  left  side  of  (92) 
is  given  by 

d  =  1  -  5£  -  7C,  +  5£2  +  13SC  +  8C,2  .  (94) 

On  the  other  hand,  the  right  side  of  (92)  is  of  the  form 

(1  -  a£  -  pt)(l  -  ~  vC)  - 

=  1  -  {a+y)l  -  (P+v)C  +  ayl2  +  (av+p^KC  +  f3vC,2  •  (95) 

2  2 

If  we  choose  constants  a,i/,p,\>  to  match  the  1,1  ,C/C  terms,  the 
numerical  values  for  av+P/j  must  then  be  (35±/85)/2  =  12.89  or 
22.11,  which  do  not  equal  the  desired  value  of  13  in  (94). 
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SUMMARY 

The  characteristic  function  of  a  general  complex  second-order 
form  in  correlated  complex  Nxl  Gaussian  random  variables  has  been 
evaluated  in  the  compact  closed  form  (75).  Its  use  requires  the 
solution  of  2Nx2N  generalized  characteristic  value  problem  (65), 
with  complex  non-Hermitian  matrices.  The  final  form  in  (75)  can 
be  accomplished  by  means  of  a  finite  product  and  a  finite  sum  of 
2N  terms,  along  with  one  square  root  and  exponential.  Rapid 
evaluation  for  numerous  values  of  complex  scalar  a  is  readily 
achieved.  The  additional  scalars  required  are  given  in  (72). 
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APPENDIX  A.  ALTERNATIVE  CHARACTERISTIC  VALUE  PROBLEMS 

An  alternative  form  of  the  eigenvalue  problem  was  derived  in 
(43),  namely 

A  R  =  R  A  ,  or  A  R  =  X  R  for  1  1  m  £  M  ,  (A-l) 

—  —  —  —  —  — m  — m  — m 

where  MxM  matrix 

A  =  C"1  B.  ( A-2 ) 

Corresponding  to  these  M  right  eigenvectors  {R^},  there  are  also 
the  left  eigenvectors  {1^}  of  matrix  A,  which  solve  the  equations 

LH  A  =  v  LH  for  1  <  m  S  M  .  (A-3) 

— m  —  -*-m  — m 

The  relationship  of  these  solutions  to  the  earlier  results  in 
(3)  and  (13),  for  ( Xm J ,  { Rm } ,  and  ( Lm } ,  is  the  subject  of  this 
appendix.  However,  the  presentation  will  be  significantly 
condensed  here,  because  it  parallels,  to  some  extent,  the 
material  in  the  main  body  of  this  report. 

From  (A-l),  we  find 

(A  -  X  I)  R  =  0  ,  det( A  -  X  I)  =  0  .  ( A-4 ) 

— m  — m  — m 

Substituting  (A-2),  this  develops  into 

det(C_1  B  -  ^  I)  =  det(C_1 )  det(B  -  X^  C)  =  0  .  (A-5) 

But,  since  matrix  C  is  nonsingular,  reference  to  (5)  yields 

X  =  X  for  1  <  m  £  M  ,  (A-6) 

— m  m 

under  some  ordering  of  the  eigenvalues.  That  is,  the  two 
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eigenvalue  matrices  are  equal:  A  =  A. 
We  can  now  write  (A-l)  in  the  form 


(A  -  Am  I) 


s* 


(C"1  B  -  A  I)  R 
'  m  — m 


=  C 


-1 


(B  -  *  C) 


m 


R 

— m 


=  0  (A-7) 


for  1  i  m  £  M.  When  we  pre-multiply  (A-7)  by  nonsingular  matrix 
C,  and  compare  the  result  with  (4),  we  see  that  we  must  have 


R^  =  Rm  um  for  1  S  m  S  M  ,  or  R  s  (Rj  .  .  .  1^]  =  R  U  ,  (A-8) 

where  U  s  diag[Uj  .  .  .  uM]  is  an  arbitrary  diagonal  matrix  of 
complex  scalar  elements.  The  scaling  of  {R^}  may  be  settled  by 
taking  them  to  be  unit  length;  then,  (6)  indicates  that  we  would 
have  |um|  =  1  for  all  m.  So,  the  right  eigenvectors  {R^  in 
(A-l)  can  be  taken  equal  to  JRmJ  in  (3),  if  desired. 

As  for  the  left  eigenvectors  { ,  develop  (A-3)  as 

(A  -  4  I)  -  0  ,  det(A  -  Xm  I )  —  0  (A-9) 

Comparison  with  (A-4)  -  ( A— 6 )  yields  **  Am  for  1  1  m  i  M.  We 
can  now  write  (A-9)  in  the  form 

IjJJ  (A  -  Am  I)  -  IjU  (C'1  B  -  Am  I)  =  iJJ  C_1  (B  -  A  C)  =  0.  (A-10) 
— m  —  m  — m  '  m  — m  m 

Comparison  with  (16)  yields  the  connection 

■  L?  c-1  -  l”  V*  ,  or  L  =  CH  L  V  for  1  S  m  i  M  ,  (A-ll) 
— m  m  m  — m  m  m 

using  the  fact  that  C  is  nonsingular,  where  (vm)  are  arbitrary 
complex  scalars.  In  matrix  form,  (A-ll)  is 

L  -  CH  L  V  ,  V  -  diag[ Vj  .  .  .  vM]  .  (A-12) 
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Scalars  { vm }  in  (A-ll)  can  be  taken  so  that  left  eigenvectors 
}L  }  have  unit  length;  that  is,  |vl  =  (lJJ  C  CH  L  )-1*. 

The  relation  for  L  in  (A- 12)  can  be  made  to  look  more  akin  to 
R  ■  R  U  in  (A-8),  by  using  (25);  namely, 

L"H  =  c_1  L~H  V_H  =  R  D~ 1  V"H  =  R  U  ,  (A- 13) 

M  __  1  —  U 

where  U  *  D  V  is  a  diagonal  matrix. 


PROPERTIES  OF  EIGENVECTOR  MATRICES  R  AND  L 

The  expressions  in  (A-l)  and  (A-3)  can  be  put  into  the  forms 
A  R  =  R  A  ,  LH  A  =  A  LH  ,  (A-14) 

with  the  help  of  ( A— 6 ) .  Now,  define  complex  Mxm  matrix 

D  =  LH  R  .  ( A- 1 5 ) 


Then,  by  arguments  similar  to  those  presented  in  (20)  -  (22), 

tHAR=DA,  LH  A  R  =  A  D  ,  D  A  =  A  D  ,  (A-16 


D  =  diag[d:  .  .  .  ]  , 


H 


in  =  III!  L  =  UH,  V1  c  Rm  =  u™  for  1  £  m  £  M 

— m  — m  — m  m  m  m  m  m  m  m 

Therefore,  the  magnitude  is  known:  Id  I  =  |u  v*  d  I . 

1  — m 1  1  m  m  m1 

Thus,  we  have  the  two  orthogonality  relations 


LH  R  =  D  ,  LH  A  R  =  D  A  , 


(A-17) 
( A- 18 ) 


( A- 1 9 ) 


where  D  and  A  are  diagonal.  Elements  {d^  can  be  made  positive. 
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EXPANSIONS  OF  MATRICES 

A  number  of  useful  expansions  and  relations  can  now  be 
developed  from  the  above  results.  From  (A-14)  and  (A-15), 


.n  _  . n  -1  _  . n  _-l  T  H 

A  =  R  A  R  =  R  A  D  L 


M  H 


( A-20 ) 


Similarly,  for  complex  scalar  p. 


p  An  =  R  (I  -  |3  An)  R-1  =  R  (I  -  P  An)  D_1  LH 


^  1  -  P  Xm  r  ,H 

d  ^m  =m  ' 
=  1  — m 


(A-21) 


These  diagonal  expansions  allow  rapid  calculation  for  numerous 
values  of  complex  scalar  p,  once  the  eigenvalues  {AmJ  and  right 
and  left  eigenvectors  {R^  and  (1^}  have  been  determined. 
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EXAMPLE 

For  the  example  considered 
following  results: 

A  =  C~1  B  = 

A  =  diag[l+i  1-i]  ,  R  =  75 


earlier  in  (33),  we  have  the 


0  1 

-2  2 


1  i 

,  ii1-1 

-1+i 

1+i  1+iJ 

1 

LH  r  =  d  =  |  I 


A  R  =  D  A  =  j 


( A-24 ) 


The  matrix  A  happens  to  be  real;  however,  its  eigenvalues  are 
complex.  Relations  ( A— 8 )  and  (A-ll)  have  been  verified  for  this 
example. 
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PROPERTIES  OF  ALTERNATIVE  PRODUCT  A  ■  B  C 

Another  form  of  the  eigenvalue  problem  was  stated  in  (44): 

LH  A  -  A  LH  ,  or  LH  A  =  X  LH  for  1  £  m  &  M  ,  (A-25) 

m  m  m 

where  Mxm  matrix 

A  -  B  C"1  .  ( A-26 ) 


Corresponding  to  these  left  eigenvectors  {Lm),  there  are  also  the 
right  eigenvectors  {Rm)  of  matrix  A,  which  solve  the  equations 

A  Rm  =  y„  5  for  1  <  m  i  M  .  (A-27) 

m  m  m  ' 

This  can  be  developed  as  follows: 

(A  -  Ym  I)  Rm  -  0  ,  det(A  -  Y„  I)  *  0  ,  ( A-28 ) 

det(B  C-1  -  ym  I)  -  det(B  -  ym  C)  det(C_1)  =  0  .  (A-29) 

Therefore,  from  (5),  ym  -  k  for  all  m.  This  enables  the 

'  '  '  m  m 

development  of  (A-28)  according  to 

(A  -  A  I)  R  =  (B  C-1  -  k  I)  R  =  (B  -  k  C)  C-1  Rm  =  0.  (A-30) 
m  m'  m  m'  m  '  m  ' 

Using  (4)  and  the  nonsingular  character  of  matrix  C,  we  find 

C'1  Rm  =  Rm  um  ,  R  =  C  R  u  ,  R  =  C  R  U  ,  (A-31) 

m  m  m  m  mm 

where  U  =  diagtu-^  .  .  .  uM).  This  can  be  compared  with  result 
R  «  R  U  in  (A-8) . 
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Regarding  the  left  eigenvectors  {LI,  (A-25)  yields 


rH  - 


Lm  <A  ~  *  0  '  det(S  -  X  I)  =  0  . 


( A-32 ) 


Comparison  with  (A-28)  -  (A-29)  yields  Xm  =  km  for  all  m.  Then, 
(A-32)  yields 


rH  ,=• 


Lm  <A  -  Xm  T)  *  <B  C"A  -  =  K  (B  "  Xm  c)  C_1  =  (A-33) 


When  we  post-multiply  (A-33)  by  nonsingular  matrix  C,  we  obtain 


Lrn  (B  -  X  C)  =0  . 
m  '  m  ' 


(A-34) 


Defining  V  -  diag[vx  .  .  .  vM],  reference  to  (16)  reveals  that 


=  Lm  vm  '  \  m  Lm  vm  '  Z  m  L  v  - 

This  can  be  compared  with  result  L  *  CH  L  V  in  (A-12). 


( A-35 ) 
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PROPERTIES  OF  EIGENVECTOR  MATRICES  R  AND  L 


The  expressions  in  (A-27)  and  (A-25)  can  be  written  as 


A  R  =  R  A  , 


rH  j 

L  A  -  A  L  • 


( A-36 ) 


Now,  define  complex  Mxm  matrix 


6  =  LH  R 


(A- 3 7 ) 


Then,  by  arguments  similar  to  those  presented  in  (20)  -  (22), 

LH  A  R  =  6  A  ,  LH  A  R  =  A  5  ,  5  A  =  A  5  ,  (A-38) 


D  =  diag[dj 


•  dM]  ' 


(A-39) 


=  l”  R  =  u_  v  LH  C  R  =  u  v  d_  for  1  1  m  i  M  .  (A-40 ) 

m  mm  mmm  m  m  m  m 


Thus,  we  have  the  two  orthogonality  relations 

LHR  =  D,  LH  A  R  =  5  A  ,  ( A-4 1 ) 

where  both  D  and  A  are  diagonal.  The  elements  can  be 

arranged  to  be  positive  real  for  all  m. 

In  summary,  the  desired  interrelationships  between  the 
alternative  characteristic  value  problems  are 


R  -  R  U  , 


L  =  C^  L  V 


for  A  =  C 


-1 


B 


(A-4 2 ) 


while 


R  =  C  R  U  ,  L  =  L  V  , 


for  A  =  B  C 


( A-43 ) 


Conversely,  having  solved  for  R,L  or  R,L,  these  equations  can  be 
used  to  solve  for  R, L. 
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EXAMPLE 

For  the  example  considered  earlier  in  (33),  we  have  the 
following  results: 


A  =  B  C 


-1  1 


10 

15+i5 

-3+i 

t 

0 

5-i5 

5-i5 

-  i 

r  1  -i 

t 

L  "  76 

i  2+i  -2-i 

l+i3 

-3+i. 

i  mi 

i  -5‘il 

1  6 

-H  =- 

1  6 

izi  i 

/  L  L  = 

-5+i  j 

16  1 

l  6  1 

f H  5  =  _  /10  _  fH  a  6  n  a  —  /10 

L  R  =  D  =  — g—  L  A  R  =  D  A  =  — g— 


1+i  0 

0  1-i 


( A-44 ) 


Relations  (A-31)  and  (A-35)  have  been  verified  for  this  example. 
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ALTERNATIVE  FORM  INVOLVING  SQUARE  ROOT  OF  C 

_u 

If  we  pre-multiply  (20)  by  C  ,  and  rearrange  the  equation, 
we  arrive  at 

C"*5  B  C"*5  (c*5  r)  =  (c*  r)  A  ,  ( A-45 ) 

which  is  a  more  symmetric  form.  This  leads  us  to  consider  the 
matrix  C  B  C  and  its  right  and  left  eigen-solutions: 

A  m  C_Js  B  C-Js  ,  A  R  =  R  A  ,  LHA  =  yLH.  (A-46) 

By  a  process  similar  to  that  employed  above,  we  find 

y  =  A  =  A  ,  R  =  R  U  ,  L  =  C**11  L  V  ,  (A-4  7 ) 

where  U  and  V  are  arbitrary  diagonal  matrices.  This  can  be 
compared  with  (A-42)  and  (A-43). 
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APPENDIX  B.  GENERAL  SECOND-ORDER  REAL  AND  COMPLEX  FORMS 

Suppose  Kxl  column  vector  X  and  Kxk  arbitrary  matrix  R  are 
real.  Let 

RS  =  i<R  +  rT>  '  Rd  =  i(R  ■  rT)  •  (b-i> 

Then, 

Rs  "  Rs  '  Rd  =  -  Rd  *  <B-2> 

Consider  the  real  scalar  quantity 

r  =  XT  R  X  =  XT  (Rs  +  Rd)  X  =  rs  +  rd  ,  (B-3) 

where  scalars 

rs  “  XT  Rs  X  ,  rd  =  XT  Rd  X  .  ( B-4 ) 

But, 

rd  -  rS  "  xT  *1  x  -  *  xT  Rd  x  “  ~  rd  •  (B-5) 

Therefore,  rd  =  0,  meaning  that  r  =  rg,  or 

r  -  XT  R  X  =  XT  Rs  X  .  (B-6 ) 

Thus,  we  need  only  consider  the  symmetric  part  of  matrix  R,  at 
least  as  far  as  quadratic  form  r  is  concerned;  that  is,  only  the 
symmetric  part  of  matrix  R  is  active  in  quadratic  form  (B-3). 

More  generally,  suppose  that  Kxl  column  vector  Z  and  kxk 
arbitrary  matrix  C  are  complex.  Let 

cs  =  ^(C  +  CH)  ,  Cd  =  |(C  -  CH)  .  ( B-7 ) 

Then, 
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Now,  consider  the  complex  scalar  quantity 

c  =  ZH  C  Z  =  ZH  (Cs  +  Cd)  Z  =  cs  +  cd  ,  ( B— 9 ) 

where  complex  scalars 

cg  =  ZH  C$  Z  ,  cd  =  ZH  Cd  Z  .  (B-10 ) 

But, 

c*  =  CH  =  ZH  CH  Z  =  zH  Cs  Z  =  cs  ,  (B-ll) 

meaning  that  c  is  real;  also, 

cd  -  cd  ■  ZH  Cd  Z  =  -  ZH  Cd  Z  =  -  cd  ,  ( B-12 ) 

meaning  that  cd  is  purely  imaginary.  Thus,  we  can  express 
( B-9 )  as 

c  -  ZH  C  Z  -  cr  +  i  cA  ,  ( B-13 ) 

where  the  two  scalars 

cr  =  ZH  cs  Z  ,  c.  =  -i  ZH  Cd  Z  ,  ( B-14 ) 

are  both  purely  real  quantities.  (If  matrix  C  is  Hermitian,  then 
H 

C  =  C,  Cg  =  C,  Cd  *  0,  and  c^  *  0,  making  c  a  Hermitian  form.) 

It  should  be  noted  that  c,  above  in  (B-9),  is  not  the  most 
general  complex  second-order  form;  the  latter  is 

C  =  ZH  Cx  Z  +  ZH  C2  Z*  +  ZT  C3  Z  +  ZT  C4  Z*  ,  ( B-15 ) 

where  C^,  Cj,  C^,  C4  are  arbitrary  complex  Kxk  matrices. 
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APPENDIX  C.  TWO  COMPLEX  COVARIANCES  OF 
A  STATIONARY  COMPLEX  RANDOM  PROCESS 

Let  z(t)  be  a  zero-mean  stationary  complex  random  process 
with  a  complex  covariance,  defined  in  the  usual  way  as 

z(t)  z*(t  -  T)  =  z(t  +  |)  Z*(t  -  |)  =  R22(t)  =  R*z(-t)  .  (C-l) 

However,  there  is  insufficient  information  in  complex  function 

R  (r)  to  determine  the  real  auto  and  cross  covariances  of  the 
zz 

stationary  real  and  imaginary  components  of  z(t).  That  is,  with 
z(t)  =  x(t)  +  i  y(t),  (C-l)  yields  the  two  real  equations 

Rxx(T)  +  Ryy(T)  =  Re  Rzz(T)  (even)  , 

Ryx(T)  "  Rxy(T)  =  Im  Rzz(T)  (odd)  *  (C_2) 

But,  we  cannot  extract  any  of  the  four  real  covariances  on 

the  left  side  of  (C-2),  even  when  we  account  for  the  fact  that 

RyX ( x )  ■  RXy ( ~T ) •  Functions  Rxx(r)  and  Ryy(r)  are  always  even 

functions  of  r,  but  R  (t)  need  not  be  odd  in  t.  (As  an  example, 

xy 

consider  y(t)  =  x(t  -  tQ).) 

In  order  to  allow  for  a  unique  solution  of  (C-2),  we  must 
also  know  the  complementary  complex  covariance  of  process  z(t), 

z(t)  z(t  -  T>  =  z(t  +  I)  z(t  '  ?}  5  Rzz<T)  *  Rzz(-T>  *  (C_3) 

(For  a  real  process  z(t),  R,,(r)  and  r_„(t)  are  identical.)  The 

Z  Z  "Z  z 

complementary  information  in  (C-3)  yields  the  two  additional  real 
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equations 

Rxx(t)  "  Ryy(r)  =  Re  5zz(t)  (even)  , 

Ryx(T)  +  RXy(T)  =  Im  rz2(t>  (even)  .  (C-4) 

The  solutions  to  simultaneous  equations  (C-2)  and  (C-4)  are  now 
available  as 


xx 


yy 


(r>  -  2  Re[Rzztr >  +  szzm]  , 

(t)  =  |  fe[Rzz(t)  -  Rzz(t)]  , 


Ryx(r)  =  i  +  R22(t)]  , 

R  <T)  =  \  Im[Rzz(t)  -  Rzz(t>]  • 


( C-5 ) 


In  the  special  case  where  complementary  covariance  R2z(t)  is 
identically  zero,  (C-5)  simplifies  to 


Rxx(r)  =  Ryy(T)  *  2  Re  Rzz(T)  (even)  ' 


Ryx<T>  =  'WX)  =  f  Im  Rzz<t>  <odd>  • 


( C-6 ) 


When  two  zero-mean  stationary  complex  random  processes  z(t) 
and  w(t)  are  involved,  the  situation  is  slightly  more 
complicated.  We  now  define  the  two  complex  cross  covariances 


z(t)  w*(t  -  t)  s  Rzw(t)  =  R*z(-t)  ' 
z(t)  w ( t  -  x )  2  Rzw(t )  =  Rwz(-t )  •  (C-7) 
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Then,  if  we  express  the  complex  random  processes  in  terms  of 
their  real  and  imaginary  parts  according  to 

z(t)  =  x(t)  +  i  y ( t )  ,  w(t)  =  u ( t )  +  i  v(t)  , 


( C-8 ) 


relation  (C-7)  develops  into 


+  R  (t )  +  i  R  (t)-iR  (t)=R  (t)  , 
xu'  ’  yv'  '  yu'  '  xv'  '  zw'  ' 

Rv  (t)  -  R  ( t  )  +  i  R  ( r  }  +  i  R  (r  )  =  R  (r), 

XU  w'  7  \711  '  7  V \7  V  7  - 7  9 


yv 


yu 


xv ' 


-zw' 


( C-9 ) 


the  solutions  of  which  are 


Rxu«»  •  I  Rehw<T>  +  Rz„<T>j  - 

V1'1  ■  5  RelRz»(t)  -  Szwm]  . 

Ryu(r)  =  |  I«.[»ZW(T)  +  S2W(T>]  , 
Rxv(t)  -  5  l">[Rzw(r|  -  RZW(T)]  . 


(C-10) 


The  four  relations  in  (C-10)  must  be  augmented  with  those  in 
(C-5),  as  well  as  with  analogous  ones  giving  the  auto  and  cross 
covariances  of  u(t)  and  v(t)  in  terms  of  R,  (t)  and  R  (r).  The 
end  result  is  that  enough  information  is  available  from  the  six 
complex  covariance  functions  rZ2(t),  rzz(t),  R^t),  ) , 

R™(T)'  R™(T)'  to  evaluate  all  of  the  auto  and  cross  covariances 
between  the  four  zero-mean  stationary  real  processes  x(t),  y(t), 
u(t) ,  and  v(t ) . 
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EXAMPLE 

Consider  the  pair  of  zero-mean  stationary  complex  processes 
£(t)  and  «i>(t)  filtered  by  arbitrary  transfer  functions  A(f)  and 
B(f),  respectively,  as  shown  in  figure  C-l.  The  corresponding 
outputs  are  z(t)  and  w(t),  respectively. 


Figure  C-l.  Two-Channel  Filtering  Operation 

The  two  input  complex  cross  covariances  are 

RCu(t)  =  C(t)  w*(t  -  r)  ,  R^w(r )  =  C(t)  w(t  -  r)  .  (C-ll) 
The  two  corresponding  input  complex  cross  spectra  are 

G£«(f)  =  J  dT  exp(-i2nfr)  R^t)  , 

G^w(f)  =  J  dr  exp( -i2nfr )  R^w(t)  .  (C-12) 

It  may  be  shown  that  the  two  corresponding  output  cross 
spectra  for  the  complex  processes  in  figure  C-l  satisfy  the  rules 
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Gzw(f)  "  GCco<f>  A<f>  B*<f>  ' 

^2W(f)  =  ^W(f>  A(f>  B("f)  ‘  (C"13) 

Now,  if  the  product  of  filter  transfer  functions  A(f)  and 

B ( -f )  is  zero  for  all  f,  then  the  complementary  output  cross 

spectrum  G  (f)  is  zero  for  all  f.  This  leads  to  complementary 

output  cross  covariance  Rzw(t)  being  zero  for  all  r,  as  utilized 

in  (C-6).  A  case  where  this  situation  arises  is  when  both 

transfer  functions  A ( f )  and  B(f)  correspond  to  one-sided  filters, 

nonzero  only  for  f  >  0.  Processes  z(t)  and  w(t)  in  figure  C-l 

are  then  analytic  processes,  because  auto  spectra  G  (f)  and 

2  2 

and  cross  spectrum  G_.T(f)  are  zero  for  f  <  0;  that  is, 

WW  ZW 

auto  covariances  R  (t)  and  R  (r)  and  cross  covariance  R_(t) 

2  2  WW  2  Vr 

are  analytic  in  the  upper-half  t -plane. 
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